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Abstract 

Max-product Belief Propagation (BP) is a popular message-passing algorithm for 
computing a Maximum-A-Posteriori (MAP) assignment over a distribution represented 
by a Graphical Model (GM). It has been shown that BP can solve a number of combinato¬ 
rial optimization problems including minimum weight matching, shortest path, network 
flow and vertex cover under the following common assumption: the respective Linear 
Programming (LP) relaxation is tight, i.e., no integrality gap is present. However, when 
LP shows an integrality gap, no model has been known which can be solved systemati¬ 
cally via sequential applications of BP In this paper, we develop the first such algorithm, 
coined Blossom-BP, for solving the minimum weight matching problem over arbitrary 
graphs. Each step of the sequential algorithm requires applying BP over a modified graph 
constructed by contractions and expansions of blossoms, i.e., odd sets of vertices. Our 
scheme guarantees termination in O(n^) of BP runs, where n is the number of vertices 
in the original graph. In essence, the Blossom-BP offers a distributed version of the cel¬ 
ebrated Edmonds’ Blossom algorithm by jumping at once over many sub-steps with a 
single BP. Moreover, our result provides an interpretation of the Edmonds’ algorithm as 
a sequence of LPs. 


1 Introduction 

Graphical Models (GMs) provide a useful representation for reasoning in a number of scien¬ 
tific disciplines [1, 2, 3, 4]. Such models use a graph structure to encode the joint probability 
distribution, where vertices correspond to random variables and edges specify conditional de¬ 
pendencies. An important inference task in many applications involving GMs is to find the 
most-likely assignment to the variables in a GM, i.e., Maximum-A-Posteriori (MAP). Belief 
Propagation (BP) is a popular algorithm for approximately solving the MAP inference problem 
and it is an iterative, message passing one that is exact on tree structured GMs. BP often shows 
remarkably strong heuristic performance beyond trees, i.e., over loopy GMs. Furthermore, BP 
is of a particular relevance to large-scale problems due to its potential for parallelization [5] 
and its ease of programnung within the modern programnung models for parallel computing, 
e.g., GraphLab [6], GraphChi [7] and OpenMP [8]. 
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The convergence and correctness of BP was recently established for a certain class of 
loopy GM formulations of several classical combinatorial optimization problems, including 
matching [9, 10, 11], perfect matching [12], shortest path [13], independent set [14], network 
flow [15] and vertex cover [16]. The important common feature of these models is that BP 
converges to a correct assignment when the Linear Programming (LP) relaxation of the com¬ 
binatorial optimization is tight, i.e., when it shows no integrality gap. The LP tightness is an 
inevitable condition to guarantee the performance of BP and no combinatorial optimization 
instance has been known where BP would be used to solve problems without the LP tightness. 
On the other hand, in the LP literature, it has been extensively studied how to enforce the LP 
tightness via solving multiple intermediate LPs that are systematically designed, e.g., via the 
cutting-plane method [22]. Motivated by these studies, we pose a similar question for BP, 
“how to enforce correctness of BP, possibly by solving multiple intermediate BPs”. In this pa¬ 
per, we show how to resolve this question for the minimum weight (or cost) perfect matching 
problem over arbitrary graphs. 

Contribution. We develop an algorithm, coined Blossom-BP, for solving the minimum 
weight matching problem over an arbitrary graph. Our algorithm solves multiple interme¬ 
diate BPs until the final BP outputs the solution. The algorithm is sequential, where each step 
includes running BP over a ‘contracted’ graph derived from the original graph by contractions 
and infrequent expansions of blossoms, i.e., odd sets of vertices. To build such a scheme, we 
first design an algorithm, coined Blossom-LP, solving multiple intermediate LPs. Second, we 
show that each LP is solvable by BP using the recent framework [16] that establishes a generic 
connection between BP and LP. For the first part, cutting-plane methods solving multiple in¬ 
termediate LPs for the minimum weight matching problem have been discussed by several 
authors over the past decades [17, 18, 19, 20, 21] and a provably polynomial-time scheme was 
recently suggested [22]. However, LPs in [22] were quite complex to solve by BP. To address 
the issue, we design much simpler intermediate LPs that allow utilizing the framework of [16]. 

We prove that Blossom-BP and Blossom-LP guarantee to terminate in 0{in?) of BP and LP 
runs, respectively, where n is the number of vertices in the graph. To establish the polynomial 
complexity, we show that intermediate outputs of Blossom-BP and Blossom-LP are equivalent 
to those of a variation of the Blossom-V algorithm [23] which is the latest implementation of 
the Blossom algorithm due to Kolmogorov. The main difference is that Blossom-V updates 
parameters by maintaining disjoint tree graphs, while Blossom-BP and Blossom-LP implic¬ 
itly achieve this by maintaining disjoint cycles, claws and tree graphs. Notice, however, that 
these combinatorial structures are auxiliary, as required for proofs, and they do not appear 
explicitly in the algorithm descriptions. Therefore, they are much easier to implement than 
Blossom-V that maintains complex data structures, e.g., priority queues. To the best of our 
knowledge, Blossom-BP and Blossom-LP are the simplest possible algorithms available for 
solving the problem in polynomial time. Our proof implies that in essence, Blossom-BP of¬ 
fers a distributed version of the Edmonds’ Blossom algorithm [24] jumping at once over many 
sub-steps of Blossom-V with a single BP. 

The subject of solving convex optimizations (other than LP) via BP was discussed in the 
literature [25, 26, 27]. However, we are not aware of any similar attempts to solve Integer 
Programming, via sequential application of BP. We believe that the approach developed in this 
paper is of a broader interest, as it promises to advance the challenge of designing BP-based 
MAP solvers for a broader class of GMs. Furthermore, Blossom-LP stands alone as providing 
an interpretation for the Edmonds’ algorithm in terms of a sequence of tractable LPs. The 
Edmonds’ original LP formulation contains exponentially many constraints, thus naturally 
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suggesting to seek for a sequence of LPs, each with a subset of constraints, gradually reducing 
the integrality gap to zero in a polynomial number of steps. However, it remained illusive 
for decades: even when the bipartite LP relaxation of the problem has an integral optimal 
solution, the standard Edmonds’ algorithm keeps contracting and expanding a sequence of 
blossoms. As we mentioned earlier, we resolve the challenge by showing that Blossom-LP is 
(implicitly) equivalent to a variant of the Edmonds’ algorithm with three major modifications: 
(a) parameter-update via maintaining cycles, claws and trees, (b) addition of small random 
corrections to weights, and (c) initialization using the bipartite LP relaxation. 


Organization. In Section 2, we provide backgrounds on the minimum weight perfect match¬ 
ing problem and the BP algorithm. Section 3 describes our main result - Blossom-LP and 
Blossom-BP algorithms, where the proof is given in Section 4. 


2 Preliminaries 


2.1 Minimum weight perfect matching 

Given an (undirected) graph G = (y, E’), a matching of G is a set of vertex-disjoint edges, 
where a perfect matching additionally requires to cover every vertices of G. Given integer edge 
weights (or costs) w = [we] G Zl^l, the minimum weight (or cost) perfect matching problem 
consists in computing a perfect matching which minimizes the summation of its associated 
edge weights. The problem is formulated as the following IP (Integer Programming): 


minimize w • x subject to ^ Xg = 1, 

eG6{v) 


X = [Xe] e {0, 1}I^I 
( 1 ) 


Without loss of generality, one can assume that weights are strictly positive.^ Eurthermore, 
we assume that IP (1) is feasible, i.e., there exists at least one perfect matching in G. One 
can naturally relax the above integer constraints to x = [xg] G [0, l]l^l to obtain an LP 
(Linear Programming), which is called the bipartite relaxation. The integrality of the bipartite 
LP relaxation is not guaranteed, however it can be enforced by adding the so-called blossom 
inequalities [23]: 


minimize w • x 

subject to ^ Xe = 1, Vx G V, ^ Xg >1, V5 G G, 

e^S{v) e^S{S) 


X = [Xe] e [0, 

( 2 ) 


where G C 2^ is a collection of odd cycles in G, called blossoms, and 6{S) is a set of edges 
between S and V \ S. It is known that if jC is the collection of all the odd cycles in G, 
then LP (2) always has an integral solution. However, notice that the number of odd cycles 
is exponential in \V\, thus solving LP (2) is computationally intractable. To overcome this 
complication we are looking for a tractable subset of G of a polynomial size which guarantees 
the integrality. Our algorithm, searching for such a tractable subset of jC is iterative: at each 
iteration it adds or subtracts a blossom. 

Tf some edges have negative weights, one can add the same positive constant to all edge weights, and this does 
not alter the solution of IP (1). 


3 



2.2 Background on max-product Belief Propagation 


The max-product Belief Propagation (BP) algorithm is a popular heuristic for approximating 
the MAP assignment in a GM. BP is implemented iteratively; at each iteration it maintains 
four messages 

: c G {0,1}} 

between every variable Zi and every associated cr G where Fi := {a ^ F \ i ^ a}\ that 
is, Fi is a subset of F such that all a in Fi include the position of 2 ; for any given z. The 
messages are updated as follows: 



= max i)cc{za) TT 

Za,:Zi=C -L-L ^ 

(3) 


jea\i 



= Me) n 

(4) 


a'eFi\a 


where each Zi only sends messages to that is, Zi sends messages to aj only if aj se¬ 
lects/includes i. The outer-term in the message computation (3) is maximized over all possible 
G {0, Ill'll with Zi = c. The inner-term is a product that only depends on the variables Zj 
(excluding Zi) that are connected to a. The message-update (4) from variable Zi to factor ijja 
is a product containing all messages received by 'ipa in the previous iteration, except for the 
message sent by Zi itself. 

Given a set of messages {m^^Q,(c), ma^i{c) : c G {0,1}}, the so-called BP marginal 
beliefs are computed as follows: 

~ n7/Q;_).2( 2 :^). (5) 

This BP algorithm outputs z^^ = [zf^] where 


^BP 


'1 if bi[l] > bi[0] 

< ? if 6i[l] = bi[0] . 
^0 if bi[l] < bi[0] 


It is known that z^^ converges to a MAP assignment after a sufficient number of iterations, if 
the factor graph is a tree and the MAP assignment is unique. However, if the graph contains 
loops, the BP algorithm is not guaranteed to converge to a MAP assignment in general. 


2.3 Belief propagation for linear programming 

A joint distribution of n (binary) random variables Z = [Zi] G {0, is called a Graphical 
Model (GM) if it factorizes as follows: for 2; = [zi] G 

Pr[Z = z] (X ^i{Zi) jq ^a{Za), 

a^F 

where are (given) non-negative functions, the so-called factors; F is a collection of 

subsets 

F = {«!, 02, ak} C 

(each aj is a subset of {1,2,..., n} with \aj\ > 2); 2:^^ is the projection of 2; onto dimen¬ 
sions included in a? In particular, ^i is called a variable factor. Assignment 2;* is called 

^For example, if = [0,1,0] and a — {1, 3}, then = [0,0]. 
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a maximum-a-posteriori (MAP) solution if z* = argmax^^{o,i}^ Pt[z]. Computing a MAP 
solution is typically computationally intractable (i.e., NP-hard) unless the induced bipartite 
graph of factors F and variables 2 ;, so-called factor graph, has a bounded treewidth [28]. The 
max-product Belief Propagation (BP) algorithm is a popular simple heuristic for approximat¬ 
ing the MAP solution in a GM, where it iterates messages over a factor graph. BP computes 
a MAP solution exactly after a sufficient number of iterations, if the factor graph is a tree 
and the MAP solution is unique. However, if the graph contains loops, BP is not guaranteed 
to converge to a MAP solution in general. Due to the space limitation, we provide detailed 
backgrounds on BP in the supplemental material. 

Consider the following GM: for x = [xi] G {0, and w = [wi] G 

Pr[X = a;] ex B P[ (6) 

i a^F 

where F is the set of non-variable factors and the factor function for cr G F is defined as 

I 1 ifAaXa > ba, C^Xa = da 
'lpa[Xa) = i „ . . 

10 otherwise 

for some matrices A^^Ca and vectors Now we consider the Linear Program (LP) 

corresponding to this GM: 


minimize w • x 

(J) 

subject to = 1, VcT G F, X = [Xi] G [0,1]^. 

One observes that the MAP solution for GM (6) corresponds to the (optimal) solution of LP 
(7) if the LP has an integral solution x* G {0,1}^. Furthermore, the following sufficient 
conditions relating max-product BP to LP are known [16]: 

Theorem 1 The max-product BP applied to GM (6) converges to the solution of LP (7) if the 
following conditions hold: 

CL LP (7) has a unique integral solution x* G {0, l}’^, i.e., it is tight. 

C2. For every i G {1,2,..., n}, the number of factors associated with xi is at most two, i.e., 

\F^\<2. 

C3. For every factor every x^ G {0, with 'ipai^a) = every i ^ a with 

Xi X*, there exists y C a such that 



\{j G {i}U7 : |Fj| : 

= 2}|<2 


= 1, 

where x'^ = | 

\xk 

[^k 

ifk ^ {i} U7 
Otherwise 

i’a{Xa) 

= 1, 

where x'l. = | 

\xk 

[^k 

ifk G {i} U 7 
otherwise 
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3 Main result: Blossom Belief Propagation 


In this section, we introduce our main result - an iterative algorithm, coined Blossom-BP, 
for solving the minimum weight perfect matching problem over an arbitrary graph, where the 
algorithm uses the max-product BP as a subroutine. We first describe the algorithm using LP 
instead of BP in Section 3.1, where we call it Blossom-LP. Its BP implementation is explained 
in Section 3.2. 


3.1 Blossom-LP algorithm 


Let us modify the edge weights: ^ We + rie.^ where ng is an i.i.d. random number chosen in 


the interval 


0 , 


1^1 


Note that the solution of the minimum weight perfect matching problem 
(1) remains the same after this modification since sum of the overall noise is smaller than 1. 
The Blossom-LP algorithm updates the following parameters iteratively. 


£ C 2^: a laminar collection of odd cycles in G. 


o ys' y and S ^ C. 

In the above, C is called laminar if for every S^T^C, Sr\T = (/), ScT or TcS. We call 
5 G £ an outer blossom if there exists no T G £ such that S CT. Initially, jC = (/) and yv = 0 
for all V ^V. The algorithm iterates between Step A and Step B and terminates at Step C. 

Blossom-LP algorithm 


A. Solving LP on a contracted graph. First construct an auxiliary (contracted) graph = 
{V^ by contracting every outer blossom in £ to a single vertex, where the weights = 
[wl : e ^ are defined as 

wi = we- y^~ E vee#. 

v&V-.v^V\e^S{v) S'e£:?;(5)0Vt,eG5(5) 

We let v{S) denote the blossom vertex in G"^ coined as the contracted graph and solve the 
following LP: 


minimize 

• X 



subject to 


Vu G 

is a non-blossom vertex 


eeS{v) 




E ^ 

Vu G W, 

is a blossom vertex 


e^5(y) 

X = [Xe] e [0, 


B. Updating parameters. After we obtain a solution x = [xg : e E of LP (8), the 
parameters are updated as follows: 

(a) If X is integral, i.e., x G {0,and J2eeS{v) = 1 for all v G V^, then proceed to 
the termination step C. 
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(b) Else if there exists a blossom S such that Xe > 1, then we choose one of 

such blossoms and update 

jC ^ and yy ^ 0^ \/ v ^ S. 

Call this step ‘blossom S expansion’. 

(c) Else if there exists an odd cycle C in such that Xg = 1/2 for every edge e in it, we 
choose one of them and update 

£^£U{y(C)} and Vv ^ ^ ^veV{C), 

eeE{C) 

where V{C)^E{C) are the set of vertices and edges of C, respectively, and d{v^ e) is 
the graph distance from vertex v to edge e in the odd cycle C. The algorithm also 
remembers the odd cycle C — C{S) corresponding to every blossom S ^ C. 

If (b) or (c) occur, go to Step A. 

C. Termination. The algorithm iteratively expands blossoms in C to obtain the minimum 
weighted perfect matching M* as follows: 

(i) Let M* be the set of edges in the original G such that its corresponding edge e in the 
contracted graph G"^ has = 1, where x — [x^] is the (last) solution of LP (8). 

(ii) If £ = 0, output M*. 

(iii) Otherwise, choose an outer blossom S ^ C, then update G"^ by expanding S, i.e. C ^ 
C\{S}. 

(iv) Let V be the vertex in S covered by M* and Ms be a matching covering using 

the edges of odd cycle G{S). 

(v) Update M* ^ M* U Ms and go to Step (ii). 


We provide the following running time guarantee for this algorithm, which is proven in 
Section 4. 

Theorem 2 Blossom-LP outputs the minimum weight perfect matching in 0{\V\^) iterations. 

3.2 Blossom-BP algorithm 

In this section, we show that the algorithm can be implemented using BR The result is derived 
in two steps, where the first one consists in the following theorem. 

Theorem 3 LP (8) always has a half-integral solution x* G {O, ^ such that the col¬ 

lection of its half-integral edges forms disjoint odd cycles. 

Proof. Eor the proof of Theorem 3, once we show the half-integrality of LP (8), it is easy to 
check that the half-integral edges forms disjoint odd cycles. Hence, it suffices to show that 
every vertex of the polytope consisting of constraints of LP (8) is always half-integral. To this 
end, we use the following lemma which is proven in the appendix. 
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(d) Solution of LP (8) in the 
3rd iteration 


(e) Solution of LP (8) in the 
4th iteration 



(c) Solution of LP (8) in the 
2nd iteration 



(f) Solution of LP (8) in the 
5th iteration 



Figure 1: Example of evolution of Blossoms under Blossom-LP, where solid and dashed lines 
correspond to 1 and ^ solutions of LP (8), respectively. 

Lemma 4 Let A = [Aij] G {0, be an invertible 0-1 matrix whose row has at most two 

non-zero entires. Then, each entry of is in {O, ±1, 

Consider a vertex x G [0, of the polytope consisting of constraints of LP (8). Then, 
there exists a linear system of equalities such that x is its unique solution where each equality 
is either Xg = 0, Xg = 1 or Xg = 1. One can plug Xg = 0 and Xg = 1 into the linear 

system, reducing it to Ax — b where A is an invertible 0-1 matrix whose column contains at 
most two non-zero entries. Hence, from Lemma 4, x is half-integral. This completes the proof 
of Theorem 3. □ 

Next let us design BP for obtaining the half-integral solution of LP (8). First, we duplicate each 
edge e ^ into ei, 62 and define a new graph ^ E^) where E^ = {ei, 62 : e G E^}. 

Then, we build the following equivalent LP: 


minimize 

■ X 


subject to 

E = 2 , 

V X G X is a non-blossom vertex 


^ ^ Xg > 2, 

eG6(v) 

V X G X is a blossom vertex 


X=[Xe]€[0,l]l®'l, 
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where w\-^ = w\^ = w\. One can easily observe that solving LP (9) is equivalent to solving 

LP (8) due to our construction of and LP (9) always have an integral solution due to 

Theorem 3. Now, construct the following GM for LP (9): 

Pr[X = x] oc Yi n i’vixsiv)), (10) 

where the factor function 'ipy is defined as 

{ 1 if is a non-blossom vertex and J2eeS{v) = 2 

1 else if is a blossom vertex and J2ee6{v) ^ 2 . 

0 otherwise 

For this GM, we derive the following corollary of Theorem 1 proven in the appendix. 

Corollary 5 If LP (9) has a unique solution, then the max-product BP applied to GM (10) 
converges to it. 

The uniqueness condition stated in the corollary above is easy to guarantee by adding small 
random noise corrections to edge weights. Corollary 5 shows that BP can compute the half¬ 
integral solution of LP (8). 

4 Proof of Theorem 2 


First, it is relatively easy to prove the correctness of Blossom-BP, as stated in the following 
lemma. 

Lemma 6 If Blossom-LP terminates, it outputs the minimum weight perfect matching. 

Proof. We let ^ [yv’>y\ v ^ V^^v{S) ^ denote the parameter values 

at the termination of Blossom-BP. Then, the strong duality theorem and the complementary 
slackness condition imply that 


xl{w^ - yl - yl) = 0, \/e = {u,v)EEK 


( 11 ) 


where y'^ be a dual solution of xf Here, observe that y^ and y^ cover ^-variables inside and 
outside of Vf respectively. Hence, one can naturally define = [yl yl] to cover all y- 
variables, i.e., yv^ys for all G y, 5 G jC. If we define x* for the output matching M* of 
Blossom-LP as X* = 1 if e G M* and X*e = 0 otherwise, then x* and satisfy the following 
complementary slackness condition: 


xU We- yl 


E J's] = 0. 

Sec / 


Me — (?i, v) G 



- 1 = 0 , V 5 G 


where C is the last set of blossoms at the termination of Blossom-BP. In the above, the first 
equality is from (11) and the definition of wf and the second equality is because the construc¬ 
tion of M* in Blossom-BP is designed to enforce JfeeS{S) ^1 = 1. This proves that x* is the 
optimal solution of LP (2) and M* is the minimum weight perfect matching, thus completing 
the proof of Lemma 6. □ 

To guarantee the termination of Blossom-LP in polynomial time, we use the following 
notions. 
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Definition 1 Claw is a subset of edges such that every edge in it shares a common vertex, 
called center, with all other edges, i.e., the claw forms a star graph. 


Definition 2 Given a graph G = {V^ E), a set of odd cycles O C 2^, a set of claws W C 2 ^ 
and a matching M C E, (O, W, M) is called cycle-claw-matching decomposition ofG if all 
sets m O U W U {M} are disjoint and each vertex v is covered by exactly one set among 
them. 

To analyze the running time of Blossom-BP, we construct an iterative auxiliary algorithm 
that outputs the minimum weight perfect matching in a bounded number of iterations. The 
auxiliary algorithm outputs a cycle-claw-matching decomposition at each iteration, and it ter¬ 
minates when the cycle-claw-matching decomposition corresponds to a perfect matching. We 
will prove later that the auxiliary algorithm and Blossom-LP are equivalent and, therefore, 
conclude that the iteration of Blossom-LP is also bounded. 

To design the auxiliary algorithm, we consider the following dual of LP (8): 

minimize E Uv 


( 12 ) 


vev^ 


subject to wl-yv-Vu^ 0, Ve = {u, v) € E\ y^(^s) >0, VS* G C. 

Next we introduce an auxiliary iterative algorithm which updates iteratively the blossom set C 
and also the set of variables yv^ys ior v ^ S ^ C. We call edge e = v) ‘tight’ if 



ys = 0. 


SeC:eeS{S) 


Now, we are ready to describe the auxiliary algorithm having the following parameters. 

O Gt ^ c c 2^, and y^, ys forv^V.S e C. 

o (O, W, M): A cycle-claw-matching decomposition of G^ 

o T C G^: A tree graph consisting of -h and — vertices. 

Initially, set G^ = G and G, T = 0. In addition, set yv^ys by an optimal solution of LP (12) 
with = w and (O, W, M) by the cycle-claw-matching decomposition of G^ consisting of 
tight edges with respect to [y^^ ys]. The parameters are updated iteratively as follows. 

The auxiliary algorithm 

Iterate the following steps until M becomes a perfect matching: 

1. Choose a vertex r from the following rule. 


Expansion. If W 0, choose a claw VL G W of center blossom vertex c and 
choose a non-center vertex r in W. Remove the blossom S{c) corresponding to c 
from jC and update G^ by expanding it. Find a matching M' covering all vertices 
in W and S{c) except for r and update M ^ M U M'. 

Contraction. Otherwise, choose a cycle G e O, add and remove it from C and 
O, respectively. In addition, G^ is also updated by contracting G and choose the 
contracted vertex r in G^ and set = 0. 
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Set tree graph T having r as + vertex and no edge. 

2. Continuously increase of every + vertex in T and decrease of — vertex in T 
by the same amount until one of the following events occur: 

Grow. If a tight edge (?i, v) exists where uis a + vertex of T and v is covered by 
M, find a tight edge w) G M. Add edges (?i, w) to T and remove w) 
from M where w becomes —, + vertices of T, respectively. 

Matching. If a tight edge (?/, v) exists where uisa. + vertex of T and v is covered 
by (7 G (9, find a matching M' that covers T U C. Update M ^ M U M' and 
remove C from O. 

Cycle. If a tight edge (?i, v) exists where v are + vertices of T, find a cycle C 
and a matching M' that covers T. Update M ^ M \J M' and add C to O. 

Claw. If a blossom vertex v{S) with yy(^s) — 0 exists, find a claw W (of center 
v{S)) and a matching M' covering T. Update M ^ M \J M' and add W to W. 

If Grow occurs, resume the step 2. Otherwise, go to the step 1. 



o 


(a) Grow 






O 

(d) Claw 



Figure 2: Illustration of four possible executions of Step 2 of the auxiliary algorithm. Here, 
we use (f to label vertices covered by matching M appearing at the intermediate steps of the 
auxiliary algorithm. 

Note that the auxiliary algorithm updates parameters in such a way that the number of vertices 
in every claw in the cycle-claw-matching decomposition is 3 since every — vertex has degree 
2. Hence, there exists a unique matching M' in the expansion step. Furthermore, the existence 
of a cycle-claw-matching decomposition at the initialization can be guaranteed using the com¬ 
plementary slackness condition and the half-integrality of LP (8). We establish the following 
lemma for the running time of the auxiliary algorithm. 
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Lemma 7 The auxiliary algorithm terminates in 0{\V\^) iterations. 

Proof. To this end, let (O, W, M) be the cycle-claw-matching decomposition of and N = 
|(9| -h I W| at some iteration of the algorithm. We first prove that \0\ -h |W| does not increase 
at every iteration. At Step 1, the algorithm deletes an element in either O or W and hence, 
|(9|-h|W| = A^ — 1. On the other hand, at Step 2, one can observe that the algorithm run into 
one of the following scenarios with respect to \0\ -h |W|: 

Grow. \0\ + |W| = - 1 

Matching. \0\ + |W| = - 2 

Cycle. |0| + |W| = AT 

Claw. \0\ + |>V| = AT 

Therefore, the total number of odd cycles and claws at Step 2 does not increase as well. 

From now on, we define : U ^ Z} to be indexes of iterations when Matching 

occurs at Step 2, and we call the set of iterations {t : U < t < U^i} as the i-th stage. We will 
show that the length of each stage is 0(|y |), i.e., for all i, 

\U-U^i\ = 0{\V\). (13) 

This implies that the auxiliary algorithm terminates in 0(|1/|^) iterations since the total num¬ 
ber of odd cycles and claws at the initialization is 0(|y |) and it decrease by two if Matching 
occurs. To this end, we prove the following key lemmas, which are proven in the appendix. 

Claim 8 At every iteration of the auxiliary algorithm, there exist no path consisting of tight 
edges between two vertices vi^V 2 G where each Vi is either a blossom vertex v{S) with 
ys = ^ or a (blossom or non-blossom) vertex in an odd cycle consisted of tight edges. 

Claim 9 Consider a -\- vertex v ^ at some iteration of the auxiliary algorithm. Then, 
at the first iteration afterward where v becomes a — vertex or is removed from (i.e., due 

to the contraction of a blossom), it is connected to an odd cycle C ^ O via an even-sized 
alternating path consisting of tight edges with respect to matching M whenever each iteration 
starts during the same stage. Here, O and M are from the cycle-claw-decomposition. 

Now we aim for proving (13). To this end, we claim the following. 

^ A -\- vertex of at some iteration cannot be a — one (whenever it appears in V^) 
afterward in the same stage. 

For proving we assume that a -h vertex v ^ dX the f-th iteration violates ^ to derive 
a contradiction, i.e., it becomes a — one in some tree T during fi-\h iteration in the same 
stage. Without loss of generality, one can assume that the vertex v has the minimum value 
oft' — t among such vertices violating We consider two cases: (a) v is always contained 
in afterward in the same stage, and (b) v is removed from (at least once, due to the 
contraction of a blossom containing v) afterward in the same stage. First consider the case 
(a). Then, due to the assumption of the case (a) and Claim 9, there exist a path P from v 
to a cycle C ^ O when the t'-ih iteration starts. Then, one can observe that in order to add 
V to tree T as a — vertex, it must be the first vertex in path P added to T by Grow during 
the f-iteration. Furthermore, tree T keeps continuing to perform Grow afterward using tight 
edges of path P without modifying parameter y until Matching occurs, i.e., the new stage 
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starts. This is because Claw and Cycle are impossible to occur before Matching due to Claim 
8. Hence, it contradicts to the assumption that t and t' are in the same stage, and completes 
the proof of ^ for the case (a). Now we consider the case (b), i.e., v is removed from due 
to the contraction of a blossom S ^ C. In this case, the blossom vertex v{S) G must be 
expanded before v becomes a — vertex. However, v{S) becomes a + vertex after contracting 
S and a — vertex before expanding v{S), i.e., v{S) also violates This contradicts to the 
assumption that the vertex v has the minimum value oft' — t among vertices violating and 
completes the proof of Due to a blossom cannot expand after contraction in the same 
stage, where we remind that a blossom vertex becomes a + one after contraction and a — one 
before expansion. This implies that the number contractions and expansions in the same stage 
is 0(|y I), which leads to (13) and completes the proof of Lemma 7. □ 


Now we are ready to prove the equivalence between the auxiliary algorithm and the Blossom- 
LP, i.e., prove that the numbers of iterations of Blossom-LP and the auxiliary algorithm are 
equal. To this end, given a cycle-claw-matching decomposition ((9, W, M), observe that one 
can choose the corresponding x = [xe] G {0,1/2, Ijl^^l that satisfies constraints of LP (8): 


Xe 


1 if e is an edge in W or M 

< ^ if e is an edge in O 
^ 0 otherwise 


Similarly, given a half-integral x = [xe] G {0,1/2, Ijl^^l that satisfies constraints of LP (8), 
one can find the corresponding cycle-claw-matching decomposition. Furthermore, one can 
also define weight in for the auxiliary algorithm as Blossom-LP does: 


wl = We- Vv- L] ys, V e G (14) 

veV-.v^Vf ,ees{v) SeC:v{S)^V^ ,eeS(S) 


In the auxiliary algorithm, e = (?i, v) G is tight if and only if 

wl-yt-yl = 0. 


Under these equivalences in parameters between Blossom-LP and the auxiliary algorithm, we 
will use the induction to show that cycle-claw-matching decompositions maintained by both 
algorithms are equal at every iteration, as stated in the following lemma. 

Lemma 10 Define the following notation: 

yt = ^ g yt] = \y^,ys-.v eV,v ^v\s e C,v{S) 

i.e., and are parts ofy which involves and does not involve in V^, respectively. Then, the 
Blossom-LP and the auxiliary algorithm update parameters £, y^ equivalently and output the 
same cycle-claw-decomposition ofG^ at each iteration. 

Proof. Initially, it is trivial. Now we assume the induction hypothesis that £, y^ and the cycle- 
claw-decomposition are equivalent between both algorithms at the previous iteration. First, it 
is easy to observe that C is updated equivalently since it is only decided by the cycle-claw- 
decomposition at the previous iteration in both algorithms. Next, it is also easy to check that 
y^ is updated equivalently since (a) if we remove a blossom S from C, it is trivial and (b) if 
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we add a blossom S = V(C) for some cycle C to C, is uniquely decided by C and in 
both algorithms. 

In the remaining of this section, we will show that once are updated equivalently, the 
cycle-claw-decomposition also changes equivalently in both algorithms. Observe that 
only depends on jC^y^. In addition, y^ maintained by the auxiliary algorithm also satisfies 
constraints of LP (12). Consider the cycle-claw-matching decomposition (O, W, M) of the 
auxiliary algorithm, and the corresponding x = [xe] G {0,1/2, that satisfies constraints 
of LP (8). Then, x and y^ satisfy the complementary slackness condition: 

Xe{wl -yl- yl) = 0, Ve = {u, v) e 

yl{S) ( IZ - 1 ) = 0, € £, 

\e€6{v{S)) ) 

where the first equality is because the cycle-claw-matching decomposition consists of tight 
edges and the second equality is because every claw maintained by the auxiliary algorithm has 
its center vertex v{S) with y^i^s) = 0 for some S ^ C. Therefore, x is an optimal solution 
of LP (8), i.e., the cycle-claw-decomposition is updated equivalently in both algorithms. This 
completes the proof of Lenuna 10. □ 

The above lemma implies that Blossom-LP also terminates mO{\V\^) iterations due to Lemma 
7. This completes the proof of Theorem 2. The equivalence between the half-integral solution 
of LP (8) in Blossom-LP and the cycle-claw-matching decomposition in the auxiliary algo¬ 
rithm implies that LP (8) is always has a half-integral solution, and hence, one of Steps B.(a), 
B.(b) or B.(c) always occurs. 

5 Conclusion 

The BP algorithm has been popular for approximating inference solutions arising in graphical 
models, where its distributed implementation, associated ease of programming and strong 
parallelization potential are the main reasons for its growing popularity. This paper aims for 
designing a polynomial-time BP-based scheme solving the minimum weigh perfect matching 
problem. We believe that our approach is of a broader interest to advance the challenge of 
designing BP-based MAP solvers in more general GMs as well as distributed (and parallel) 
solvers for large-scale IPs. 
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A Proof of Lemma 4 

Eor the proof of Lemma 4, suppose there exists a row in A with one non-zero entry. Then, 
one can assume that it is the first row of A and An = 1 without loss of generality. Hence, 
A^-^ = 1, A^^ = 0 for i 1 and the first column of A~^ has only 0 and ±1 entries since 
each row of A has at most two non-zero entries. This means that one can proceed the proof of 
Lemma 4 for the submatrix of A deleting the first row and column. Therefore, one can assume 
that each row of A contains exactly two non-zero entries. 

We construct a graph G = (y, E) such that 

V = [m] := {1,2,..., m} and E = {(j, k) : aij — aik — 1 for some i G y}, 

i.e., each row = (A^i,..., and each column A[^]^ = (Ai^,..., A^^)^ correspond 
to an edge and a vertex of G, respectively. Since A is invertible, one can notice that G does 
not contain an even cycle as well as a path between two distinct odd cycles (including two odd 
cycles share a vertex). Therefore, each connected component of G has at most one odd cycle. 
Consider the i-th column Aj^j^ = (A{"^^,..., A“^)^ of A~^ and we have 

= l and = 0 for j ^ i, (15) 

i.e., Aj^j^ assigns some values on V such that the sum of values on two end-vertices of the 
edge corresponding to the A;-th row of A is 1 and 0 if A: = i and k i, respectively. 

Let e = (u^v) ^ E be the edge corresponding to the i-th row of A. 

• Eirst, consider the case when e is not in an odd cycle of G. Since each component of G 
contains at most one odd cycle, one can assume that the component of is a tree in the 
graph G\e. We will find the entries of A~^ satisfying (15). Choose A~l = 0 for all 
vertex w not in the component, and A“^ = 1. Since the component forms a tree, one 
can set A~l = 1 or — 1 for every vertex w ^ uin the component to satisfy (15). This 
implies that Aj^j^ consists of 0 and ±1. 
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• Second, consider the case when e is in an odd cycle of G. We will again find the entries 
of satisfying (15). Choose = A~l = ^ and A~l = 0 for every vertex w not 
in the component containing e. Then, one can choose satisfying (15) by assigning 

A~l = ^ or — ^ for vertex w ^ u^v in the component containing e. Therefore, 
consists of 0 and zb^. 

This completes the proof of Lemma 4. 

B Proof of Corollary 5 

The proof of Corollary 5 will be completed using Theorem 1 . If LP (9) has a unique solution, 
LP (9) has a unique and integral solution by Theorem 3, i.e.. Condition Cl of Theorem 1. LP 
(9) satisfies Condition C2 as each edge is incident with two vertices. Now, we need to prove 
that LP (9) satisfies Condition C3 of Theorem 1. Let x* be a unique optimal solution of LP (9). 
Suppose X is a non-blossom vertex and = 1 for some / ^s{v)’ If ~ 1 

for e G S{v), there exist / G 5(x) such that x/ Xj = 0. Similarly, If Xe x* = 0 for 
e G 5(x), there exists / G 5(x) such that xj Xj = 1. Then, it follows that 


'^vix'siv)) 

= 1 , 

where x', = | 

if e' i {e, /} 

Le' 

Otherwise 

'^vix'siv)) 

= 1 , 

where x', = L® 

if e' e {e, /} 

\K' 

Otherwise 


Suppose X is a blossom vertex and 'ipv{xs{v)) = 1 for some ^ ^6{v)' If ^ 1 

for e G (^(x), choose / G 5 (x) such that x/ 7 ^ Xj = 0 if it exists. Otherwise, choose / = e. 
Similarly, If Xe 7 ^ x* = 0 for e G S{v), choose / G 6{v) such that x/ 7 ^ Xj = 1 if it exists. 
Otherwise, choose / = e. Then, it follows that 


'>Pv{Xs{v)) = 1 , 

/ 1 ^e' 

where x , = < 

if e' ^ {e, /} 


Otherwise 

'>Pv{x's{v)) = 1 , 

where x', = 1 ^*^ 

if e' G {e, /} 


Otherwise 


C Proof of Claims 

First observe that (see (14) for its definition) is updated only at Contraction and Expan¬ 
sion of Step 1. If Contraction occurs, there exist a cycle C to be contracted before Step 1. 
Then one can observe that before the contraction, for every vertex x in C, yy is expressed as a 
linear combination of : 

= l T. ( 16 ) 

eeE(C) 
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where dc{v^ e) is the graph distance from vertex v to edge e in the odd cycle C. Moreover 
is updated after the contraction as 

{ wl, ^ w\ — yy if V is in the cycle C and e ^ 6 {v) 
wl ^ wl otherwise 

Thus the updated value wl can be expressed as a linear combination of the old values where 
each coefficient is uniquely determined by . One can show the same conclusion similarly 
when Expansion occurs. Therefore one conclude the following. 

X Each value wl at any iteration can be expressed as a linear combination of the original 
weight values w where each coefficient is uniquely determined by the prior history in 
Gt. 

To derive a contradiction, we assume there exist a path P consisting of tight edges between 
two vertices vi and V2 where each Vi is either a blossom vertex v{S) with ys — ^ or di vertex in 
an odd cycle consisting of tight edges. Consider the case where vi and V2 are in cycle Ci and 
C 2 consisting of tight edges, where other cases can be argued similarly. Then one can observe 
that there exists a linear relationship between yy and yu and w "^: 

(17) 

eeP 

where dp{v 2 ^vi) and dp{e^vi) is the graph distance from vi to V 2 and e, respectively, in 
the path P. Since vi^V 2 are in cycles Gi,G 2 , respectively, we can apply (16). From this 
observation, (17) and X, there exists a linear relationship among the original weight values w, 
where each coefficient is uniquely determined by the prior history in . This is impossible 
since the number of possible scenarios in the history of G^ is finite, whereas we add continuous 
random noises to w. This completes the proof of Claim 8. 

D Proof of Claim 9 

To this end, suppose that a + vertex v at the t^-th iteration first becomes a — vertex or is 
removed from at the t^-ih iteration where t^-ih iterations are in the same stage. First 
observe that if v is removed from G^ at the t^-th iteration, there exist a cycle in O that includes 
it at the start of the t^-ih iteration, resulting a zero-sized alternating path between such vertex 
and cycle, i.e., the conclusion of Lemma 9 holds. Now, for the other case, i.e., v becomes a — 
vertex at the t^-th iteration, we will prove the following. 

★ For any t-ih iteration with one of the followings holds: 

1. The vertex v becomes a + vertex during the t-ih iteration. Moreover, v either 
becomes a + vertex during the {t + l)-th iteration or v becomes connected to 
some cycle G in O via an even-sized alternating path P consisting of tight edges 
at the start of {t -h l)-th iteration. 

2. The vertex v is not in the tree T during the t-ih iteration. Moreover, if v is con¬ 
nected to some cycle G in O via an even-sized alternating path P consisting of 
tight edges at the start of t-ih iteration, v remains connected to cycle G in O via 
an even-sized alternating path P consisted of tight edges at the start of {t -\- l)-th 
iteration, i.e. the algorithm parameters associated with P and G are not updated 
during the t-ih iteration. 
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For ★ — 1, observe that if v becomes a + vertex during the f-th iteration, the iteration termi¬ 
nates with one of the following scenarios: 

1. The iteration terminates with Matching. This contradicts to the assumption that t^-ih 
iterations are in the same stage, i.e., no Matching occurs during the t-ih iteration. 

II. The iteration terminates with Cycle. The vertex v is connected to the cycle newly added 
to O via an even-sized alternating path consisting of tight edges in tree T at the start of 
the next (i.e., {t -\- l)-th) iteration. 

III. The iteration terminates with Claw. The vertex v becomes a -h vertex of tree T of the 
next (i.e., {t -\- l)-th) iteration. This is due to the following reasons. After Claw, the 
algorithm expands the center vertex of newly made claw W by Expansion in the next 
iteration. Then, there exists an even-sized alternating path Pw from r to consisted of 
tight edges in the newly constructed tree T. Furthermore, edges in Pw are continuously 
added to T by Grow without modifying parameter y in Step 2 until v becomes a -h 
vertex in T. This is because Claw and Cycle are impossible to occur due to Claim 8. 

For ★ — 2, in order to derive a contradiction, assume that a vertex v violates ★ — 2 at some 
iteration, i.e. the algorithm parameters associated to the even-sized alternating path P and the 
cycle C in the statement of ★ — 2 are updated during the iteration. Observe that the algorithm 
parameters are updated due to one of the following scenarios: 

I. The cycle C is contracted. If v is in C, v no longer remains in and contradicts to the 
assumption that v remains in V^. If v is not in C, v becomes a -h vertex in tree T after 
continuously adding edges of P by Grow without modifying parameter y due to Claim 
8 . This contradicts to the assumption of ★ — 2 that v is not in tree T during the t-th 
iteration. 

II. A vertex in C is added to tree T. Then, Matching occurs, i.e. the new stage starts. This 
contradicts to the assumption that t^-ih iterations are in the same stage. 

III. An edge in P is added to tree T. Then, there exists a vertex uin P that first became a 
— vertex among vertices in P, and it either (a) has an even-sized alternating path P' to 
C consisting of tight edges or (b) has an odd-sized alternating path P' to v consisting 
of tight edges. For (a), the edges in P' are continuously added to T without modifying 
parameter y by Claim 8 and Matching occurs. This contradicts to the assumption again. 
For (b), P' are added to T without modifying parameter y due to Claim 8, and v is added 
to tree T as a + vertex. This contradicts to the assumption of ★ — 2 that v is not in tree 
T during the f-th iteration. 

Therefore, ★ holds. One can observe that there exists G such that at the f*-th 

iteration, v last becomes a + vertex before the t^-th iteration, i.e. v is not in tree T during 
t-th iteration for f* < t < Then v is connected to some cycle C in O via an even length 
alternating path P at (f* + l)-th iteration and such path and cycle remains unchanged during 
t-th iteration for P < t <t^ due to ★. This completes the proof of Claim 9. 
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